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Abstract 



We are concerned with three types of uncertainties: probabiHstic, possibilitis- 
tic and interval. By using possibility and necessity measures as an Interval Valued 
Probability Measure (IVPM), we present IVPM's interval expected values whose 
possibility distributions are in the form of polynomials. By working with interval 
expected values of independent uncertainty coefficients in a linear optimization 
problem together with operations suggested in Lodwick and Jamison [3], the prob- 
lem after applying these operations becomes a linear programming problem with 
constant coefficients. This is achieved by the apphcation of two functions. The 
first is applied to the interval coefficients, v : I K'^ , where I = {[a,b] \ a<b}. 
The second is u : R'' ^ R, applied to the product we got from a previous func- 
tion. Similar concepts hold for any types of optimization problems with linear 
constraints. Moreover, it implied that optimization problems containing all three 
types of uncertainties in one problem can be solved as ordinary optimization prob- 
lems. 

1 Introduction 

An Interval Valued Probability Measure (IVPM) which is generated from the definitions 
provided by Weichselberger [8], is a tool that gives a partial representation for an 
unknown probability measure. In this paper we expand the idea in [3] of using an IVPM 
to an optimization problem with uncertain coefficients. The types of these uncertainties 
in this research are probabilistic, possibilistic and interval uncertainties. We provide 
the necessary definitions and explanations in the next section. 

To apply in an optimization problem, we will use the interval expected value described in 
section[2]as the representative of each uncertain coefficient. We construct a general form 
of an interval expected value whose IVPM construction forms a polynomial possibility 
density function. 



In section [3j by assuming independence, we apply interval expected values to all uncer- 
tain coefficient random variables. We create an algorithm for a linear program (LP) with 
interval uncertainty coefficients. Using this algorithm, we show that our uncertainty 
problem becomes an ordinary LP. Similar details are given in section ID Examples, 
conclusion and further research idea are provided. 

2 Interval Valued Probability Measure (IVPM) 

Before giving the definition of an IVPM, we would like the readers to feel comfortable 
with the notation m. 

{m; or 
m; or ; where 
[mi, 1712] 

fh is corresponding to m as a random variable with probabilistic distribution and m 
means that m is a random variable, with possibilistic distribution. 

In real applications, we might not know (with certainty) the probability measure for our 
problems. Lodwick and Jamison [3] use an IVPM, irhi^) = [^^C^)' ^jk(^)] ' measure 
a partial representation for an unknown probability measure. The original paper for 
the idea of IVPM is adopted by Weichselberger [^. We use the following notation and 
information throughout the paper unless stated otherwise: 

• The arithmetic operations applied to intervals are those of interval arithmetic [4]. 

• The set of all intervals contained in [0, 1] is denoted as 

Int[o,i] = {[a,b] I < a < 6 < 1} . 

• S denotes the universal set and ^ is a cr-algebra of <S. Note that 5 = R. 

Definition 2.2 (Weichselberger [8]) Given measurable space {S,A), an interval valued 
function irh ■ A Q A ^ Intp^i] is called an R-probability if: 

• in^{A) = [^Z{A),i+{A)] C[0,1], 

• 3 a probability measure, Pr, on A such that G A, Pr (^4) G irh (A) . 

An R-probability from definition [22] is an IVPM where and i'^ are constructed from 
a possibility (fuzzy) density function. 
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Definition 2.3 A function p : S ^ [0, 1] is called a regular possibility distribution 
function if 

sup{p(x) I X G 5} = 1. 

Possibility distribution functions (see |7j) define a possibility measure, Pas : 5 ^ [0, 1] 
where 

Pos {A) = sup {p (x) j X G A} 
and its dual necessity measure is 

Nec (^) = 1 - Pos {A^) , 

where sup{p(x) | x G 0} = 0. A necessity distribution function n : 5 ^ [0, 1] can be 
defined by setting 

n{x) = 1 — p (x) 
and the corresponding necessity measure 

Nec {A) = inf {n (x) | x G A""} , 

where inf {n (x) | x G 0} = 1. 

In [2], it is shown that possibility distributions can be constructed which satisfy the 
following consistency definition. 

Definition 2.4 Let p : 5 ^ [0, 1] be a regular possibility distribution function with 
associated possibility measure Pos and necessity measure Nec. Then p is said to be con- 
sistent with random variable X if for every measurable set A, Nec {A) < Pr (X G A) < 
Pos {A). 

The R-probability function in definition 12.21 is used to define IVPMs. A possibility 
and necessity pair, iifi{A) = [Nec[A).^Pos{A)\, constructed by definition 12.41 is able to 
bound an unknown probability of interest. Therefore it can be used to define an IVPM. 
The reader could find more explanations, examples and a construction of an IVPM in 

m 



2.1 The Interval Expected Value Constructed From Polynomial Pos- 
sibility Density Function 



In this paper we consider the interval expected value (definition is given in [3]), 



xdXrh. 



R 



xd {x)dx, / xd^{x)dx 



(1) 



of an IVPM constructed from possibility and necessity measures as the specific upper 
and lower cumulative probability distribution functions, respectively. When the interval 
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expected value is calculated as we will see, the lower cumulative distribution function 
gives the right end-point of the interval expected value, while the upper cumulative 
distribution function defines the left end-point. We give a formal definition of the 
interval expected value in definition 12.51 

Definition 2.5 The interval expected value is defined in ([TJ, where d~{x) refers to 
the left possibility density function corresponding to the upper cumulative distribution. 
Similarly, is the right possibility density function corresponding to the lower 

cumulative distribution. 



This definition will become clear when we present how to calculate the interval expected 
value through a polynomial possibility density function. 

Definition 2.6 A polynomial degree n fuzzy number a/b/c/d, is a random number 
whose value is fuzzy between a and d. The corresponding polynomial fuzzy membership 
function / : R — > [0, 1] is defined as 



fix) 



fiix) ; Vx G [a, 6) 
1 ; Vx € \b, c] 

; Mx G (c, d] 
; otherwise, 



where fi and Jr are defined in table l2.1[ We can use / as a polynomial possibility density 
function when we have a corresponding possibilistic uncertainty random variable. 



Consider a polynomial degree n fuzzy number a/b/c/d^ core [6, c], support [a, d], the 
corresponding fuzzy membership function (or possibility density function) which origi- 
nally comes from a polynomial function where n = 1,2,3, .. . has the general form 
as shown in table 12.11 



Table 2.1: General form of a polynomial possibility density function 



n 


Left Density Function 


odd 


/l(x)= (^(x-6r + l 


even 


fL{x) = -j^{x-hr + i 


n 


Right Density Function 


odd 


/i?(^) = -(5V(^-cr + i 


even 


fL{x) = -jj^{x-cr + l 
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In general, the upper cumulative (Possibility measure) and the lower cumulative (Neces- 
sity measure) distribution functions generated by polynomial possibility density func- 
tion are and F'' , respectively, where 



F"(x) = Pos{x) 



; a; < a 
fUx) ■,a<x<b 

1 [b < X 



and 



F\x) = Nec{x) = < 



; X < c 

1 - fR{x) •,c<x <d 
1 :d < X. 



For the odd number of n, we calculate the left and right density functions respectively 
as follows: 



d-{x) = A[i7»(^)] 







;a<x<6 
; otherwise, 







-(x 



\n— 1 



; c < X < d 
; otherwise. 



The upper cumulative distribution produces the lower integral and the lower cumulative 
distribution produces the upper integral. Therefore 



and 



/: 



xd {x)dx = o + 



vd''^{x)dx = d 



b — a 
n + 1 

d — c 



'-00 n+l 

Similar work could be done for the even degree. Thus, the interval expected value of an 
IVPM constructed by a polynomial possibility density function degree n where n G N 
is 

b — a , d — c 



xdir 



R 



a + 



n + 1 



n + 1 



Remark 2.1 The interval expected value of an IVPM constructed from a constant c 
or an interval [a, 6], (uniform regular possibility density function), is the constant or the 
interval themselves. 

Remark 2.2 For any continuous possibility density function with fuzzy number a/b/c/d 
whose core is [6, c] and support is [a, d], the interval expected value J^xdi^h = [a,/3] C 
[a,d], where a G [a,b] and /? G [c,d]. 

Proof: It is a property of an expected value, o 
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3 IVPM with Linear Programming 



Consider a linear programming (LP) with some uncertainty coefficients 

n 

max /(x, a) := OjXj (2) 
1=1 

n 

s.t. g{x,b,c) ■.= '^bjiXi + cji = 0;j = I, . . . ,m 

i=l 

< X <t; where t > 0, 

where some components of o, b and c could represent probabilistic, possibilistic, or 
interval uncertain random variables. The bound on vector x could be oo. In this paper 
we consider the situation when these random variables are mutually independent. 

Definition 3.1 (Lodwick and Jamison [3j) The IVPM constructed from two uncertain 
independent random variables, X and Y, is defined as 

Unlike in the ordinary LP, for this paper a problem might have no feasible region. 
Instead, the constraints g{x, b,c) = mean that g can come as close to zero as possible. 
Therefore, it is reasonable to use penalty strategies for this type of problem. For example 
in [3] 

max /(x, a) := 8xi + 7x2 
s.t. 5i(x, b, c) := 3xi + [1, 3]x2 + 4 = 

g2{x, b, c) := 2xi + 5x2 + 1 = 

X G [0, 2] , 

where 2 = 1/2/2/3. It is easy to see that this problem has no feasible set. Therefore, 
the solution x* for a modified problem does not need to satisfy the constraints of the 
original one. 

Lodwick and Jamison [3] present an idea to deal with problem ^ which involves interval 
types of uncertainties by using the IVPM and the operations in the order below. The 
explanation of these steps follows: 

1. apply a penalty cost p > (determined by a decision maker) to g{x, b, c) 

2. calculate the interval expected value 

h (jc, a, b, cj c^^^xfexc ( combining all liked terms Xj's together or not is depend- 
ing on the user), where h (x,a,b, cj = f{x,a) — p ■ g{x,b,c) , 
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3. apply the ordered function V[a,f3] '■ [o^; P] ~^ to the interval coefficient [a, /?] of 

h (^x, a, b, cj di^^i^^ from step 2, 

4. determine ([Oj/?])) where uya,f3] : R'^ ^ R, 



By assuming penalty cost vector p > d to the constraints 
becomes 



g{x, b, c) 



, the problem 



For now, we ignore the fact that 



g{x,b,c) 



max h[x,a,b,c) ■.= f{x,a)—p- g{x,b,c) (3) 

is a non smooth function and consider it 
as a linear function, so that we can explain clearly each step of the operations above. 
Next, by using the assumption that all uncertain random variables are independent, we 
form an IVPM ^^^bxc then calculate the interval expected value with respect to this 
IVPM. We get 

/i(x,a,M)'i^sxf,xc- (4) 

Since ^^^bxc ^ h ^ ^ independent), the equation is a triple integral 

with respect to ig, and ig. We consider Xi as a constant while finding the interval 
expected value for the IVPM. We get a linear function with interval coefficients as a 
result for this step. 

Noting that if we find the interval expected value for each function / and g before 
applying the violation cost, the result up to this point is the same as working with 
violation cost then the interval expected value of function h. So far we achieve a linear 
unconstrained objective function with interval coefficients. 

The next question is how to deal with these coefficients to keep as much information 
about the interval as possible. This information is dependent on the decision maker. He 
might use the midpoint as his priority, or he might want to keep track on the length of 
the interval. So the decision maker needs to put his priorities in the order. For example, 
he might use the midpoint as his first priority since it is the best estimate for the true 
value. Then his second priority could be the length of this interval because together 
with the midpoint, he will be able to get back to his interval easily. His third priority 
could be the right end point of the interval because he did not want to excess that limit, 
and so on. The decision maker also can have different orders and (or) methods for each 
of intervals. 

The decision maker will write down the function f [a,/3] : [a, /3] — > R'^ to represent his k 
priorities. For example when k = 3, 

( ^ 
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For the different interval coefHcient [p,!^], the corresponding function might have 
different orders from 

Now, the decision maker might weigh these priorities equally or might have some fancy 
strategy to deal with them. Again, these strategies depend on the interval [a, (3] and 
the opinion of the decision maker. For example, given equal importance, he can define 
the function ii[a,/3] : R*^ ^ R as 

1 fa + P\ 1,^ , 1^ 

+ o(/5-")+ o/5- 




3 V 2 y 3" '3' 



The bottom line is that now the interval coefficients become a real number by using the 
functions U[a,/3] ^-^d ^[a,/?] on the interval coefficient [a,/3], i.e. 

U[a,f3] (^^[a,/3] ([«,/?])) £ R- 



Therefore, we transform our original problem to a linear unconstrained objective func- 
tion problem with real coefficients. Together with the bound on x we get a solution for 
our transformation problem, (drop the subscript [a,/?] from functions u and v), 




Unfortunately, we have to deal with the non smooth function, h{x,a,b,c). Also we will 
not be that lucky to get a linear unconstrained objective function after these operations. 

By looking at step 2 suggested above carefully, we can calculate the interval expected 
value of each constraint Qi and objective function / before applying a penalty cost p to 
them (without changing the result at the end of step 4). So, there will be some changes 
in the operations stated above. The operations we use in this paper are in the following 
steps. 

Algorithm 3.1 IVPM with interval uncertainty coefficients LP. 

1. Calculate the interval expected value of each gi{x,a,b,c), and f{x,d), i.e., find 
/j^5i(f, b, c) di^^i^g for i = 1, . . . , m and f(x, a) di^^i^^ . For convenience, we 
store the result of this step as 

/(x) ^ / f{x,a)dL^^^. 
Jr 

9i{x) ^ I gi{x,b,c)di. i = l,...,m. 

Jr 
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2. Apply the ordered function f [a,/?] : [a, /?] — > R'^ to the interval coefficient [a, (3] of 
f{x) and gi{x) received from step 1. Again, store the result as 



fix) ^ v(^j^fix,a)dL^f^^ 
Qiix) ^ V (^j^giix,b,c) di^^i^^ -,1 = 1,. . . ,111. 

3. Determine U[a,i3] (^[a,/3] ([o^)/^])) € R to the coefficient f[Q,/3] ([a,/5]) of fix) and 
giix) received from step 2, where u^a,i3] : R'^ ^ R- Store the result as 

fix) ^ u{v(^j^fix,a) di.^^i 

giix) ^ ^i^i^j 9iix,b,c)di^ 



xbxc 

Now, the coefficients of / and gi are all constants and we approach the following 
LP problem 

max fix) 
s.t. giix) = 0; i = l,...,m (5) 

< X < t; where t > 0, 

4. Apply a penalty cost p > to the function vector g received from step 3. Define the 
penalty function = fix) —p^ \gix)\. The problem becomes an unconstrained 
objective function to maximize the function 

5. Use modeling techniques to get rid of non-smooth absolute function, |(7(x)|. 

In general, the penalty vector p is not a fixed vector. It depends upon the excess or 
shortage of function g from 0. Moreover, one of the modeling difficulty is that we could 
not know in advance which constraint will lack or excess the balance zero. Let us denote 
$ej and $Sj as the cost penalty for each excess and shortage unit of giix) from zero, 
respectively. Noting that gix, b, c) , the absolute of the function vector g, is a non 

smooth function. So we define ipi := max {0,gi(x)} and d := max {0,—giix)}, for 
i = 1, . . . ,m. Then the unconstrained problem got form step 4 of Algorithm 13.11 

T 



max := /(x) —p \gix)\ 
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can be remodeled as 

max h{x, if, () := f{x) - Xl^i Siipi - YT=i •^iCi 



(6) 



s.t. 



■01 > 9i{x) 
Ci > -9i{x) 
> 

>o 



1, . . . ,m; 



< X < t; t > 0. 

Prom the explanation above we provide the conclusion in the following lemma. 

Lemma 3.1 Consider an LP jS]), after working through the algorithm 13.11 the remod- 
eled problem ^ becomes an LP problem. 

Proof: It is clear from the algorithm 13.11 
Example 3.1 Consider the problem 



max f{x,a) 
s.t. 5i(x, 6,c) 
92{x, b, c) 
93{x, b, c) 



2x1 - 3x2 + [3, 5] X3 
4x1 + [1,5] X2- 2x3 -[0,2] =0 
6x1 - 2x2 + 9x3 - 9 = 
-2x1 - [l,4]x2 -8x3 + 5 = 
< xi < 3 
< X2 < 2 
< X3 < 2, 



where a 



4 [1,5] 
2,-3, [3,5] ,b= 6 -2 9 
-2 -[1,4] 

Note: The functions / and 33 involve 3 types of uncertainties 



and c = [- [0,2] ,-9,5]' 



These coefficients have possibility (or probability) polynomial density functions as 
shown in table 13.21 Apply Algorithm 13. II step by step, we have: 
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Table 3.2: Polynomial possibility density function for the coefficients 



coefficient 


a/b/c/d 


degree of polynomial distribution 


2 


0/1/2/3 


2 


3 


2/3/3/4 


1 


4 


2/4/4/6 


1 


2 


1/2/2/3 


1 


8 


7/8/8/9 


3 


5 


4/5/5/6 


1 



1. Calculate the interval expected values 



/(^) 



92{x) 



xi - [3, 3] X2 + [3, 5] X3 

xi + [-3, -3] X2 + [3, 5] X3 ; 



1 8 
3' 3 

1 8 
3' 3 

[3,5] xi + [l,5] a;2 - 2x3 - [0, 2] 
[3, 5] XI + [1,5] X2 + [-2,-2]x3 + 
[-2,0] ; 

6x1 - [2, 2] X2 + 9x3-9 
[6,6]xi + [-2,-2] X2 + [9,9]x3 
+[-9, -9] ; 

"29 35" 

T'T_ 

[-2,-2]xi + [-4,-1] X2 + 
35 29' 



-2x1 - [1,4] X2 



X3 + 5 



X3 + [5,5] 

2. Assume that v [a,/?] = — cxj , therefore 



m 

92{x) 



.3 7 



)xi + (-3,0)x2 + (4,l)x3 ; 



'2' 3' 

(4,l)xi + (3,4)x2 + (-2,0)x3 
+(-1,2); 

(6,0)xi + (-2,0)x2 + (9,0)x3 
+(-9,0) ; 



11 



g^{x) ^ (-2,0)xi + (-|3)a;2 + (-16,^)x3 
+(5,0). 

3. The user applies the function u : — ^ R as u ((ai, 02)) = , when the original 
constants are uncertain and u ((01,02)) = ai, when the original coefficients are 
constants. 

f(-^ 23 3 5 

Ti.x) <r- —xi - -X2 + -X3 ; 

5 7 1 

9i{x) ^ -xi + -X2 - 2x3 + - ; 

92{x) ^ 6x1 - X2 + 9x3 - 9 ; 

o 1 29 5 

93{X) ^ -2X1 + -X2 - — X3 + -. 

4. Choose si = S2 = S3 = $2, and ei = 62 = 63 = $1. The problem becomes 

max h{x) := yXi - ^X2 + ^X3 - \g{x) \ . 

5. Remodel the problem in step 4: 

^ ^ 23 3 5 

max h{x, tp, Q := —xi - -X2 + -X3 - 2V'i 

-2V'2 - 2V'3 " Ci - C2 - Cs 
5 7 1 

S.t. Ipi > -Xi + -X2 - 2X3 + - 

■02 > 6X1 — X2 + 9X3 ~ 9 

^ n 1 29 5 

■03 > -2X1 + ■^X2 - — X3 + - 

5 7 „ 1 
Ci > -2^1-2^2 + 2x3-- 

C2 > -6X1 + X2 - 9X3 + 9 

1 29 5 

Cs > 2X1 - -^X2 + — X3 - - 

< xi < 3 
< X2 < 2 
< X3 < 2 

V'i>0, Ci>0; z = 1,2,3. 



Solving this problem using GAMS, we have an optimal solution at 
(xi,X2,X3,'(/'i,V'2,V'3,Ci,C2,C3) = (0.3913,0,0.7391,0,0,0,0,0,3.6413) and the optimal 
objective value is -0.2935. 
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4 IVPM with Quadratic Programming 



In this section we start with a quadratic programming (QP) with some independent 
uncertainty coefficients as follow, 



max f{x, M,b) := ^x^Mx + b^x 

n 

S.t. g{x,c,d) := '^cjiXi + dji = 0; j = 1, . . . ,m 

i=l 

< X <t; where t >0. 



(7) 



Note that 



M 



ail 



air, 



is not necessarily a symmetric matrix. Also, f{x,M,b) is a quadratic function with 
uncertain coefficients and g{x, c, d) is a linear function vector. Elements of M, b, c and 
d could be constant, possibilistic, fuzzy or interval uncertain random variables. 

By applying the Algorithm 13.11 to this QP, the remodeled problem for ^ is similar to 
the problem ([6]). The only difference is that the function / is now a quadratic function. 
So we can rewrite the problem jH]) as 

max h{x, if, (f) := ^x^Mx + P^x — i Ciipi 



(8) 



s.t. 



tpi > Qiix) 
Ci > -9i{x) 
ipi > 

>o 



L, . . . , 



m: 



< X < t; t>0. 



where M and b are generated from step 3 and step 4 of Algorithm 13.11 Function g 
is now a linear constrained function vector whose coefficients are constants. Without 
loss of generality, M can be a symmetric matrix. If M is positive or negative definite, 
it will be fairly easy to solve this remodeled problem jS]). However, we can not get a 
nice form of matrix M in general. It depends on the types of uncertain coefficients and 
how the decision maker defines function u and v. (In this case, we can use technique of 
elimination of variables using linear constraints, [5] , to get at least a stationary point. 
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Another method we could consider is one using complementarity problem and modify 
the QP problem to a linear problem with complementarity constraints [T].) 

Prom the work in section 3 and 4, we can conclude that if we start with an optimization 
with uncertain coefficients and linear constraints, the Algorithm 13.11 leads us to the 
same type of optimization problem with constant coefficients. 

We illustrate an example of a QP problem by changing the objective function of example 
EH 

Example 4.1 We use the example 13.11 The only difference is the objective function, 
i.e., /(x, a) := 2xi — 3x2 + [3, 5] X3 becomes /(x, a) := 2x1 ~ ^^2 + I^' ^] ^3- 

By go through the steps in the algorithm 13.11 the calculation remains the same as one 
in example 13. 11 Therefore, in the step 5 we achieve 

max h{x, -if, Q := - \xl + ^xs - 

b 2 2 

-2^2 - 2i^3 - Ci - C2 - C3 

5 7 1 

s.t. Ipi > -Xi + -X2 - 2X3 + - 

1p2 > 6X1 - X2 + 9X3 - 9 

1 29 5 

W3 > -2X1 + -^X2 - — X3 + - 

5 7 1 
Cl > -^Xi - -X2 + 2x3 - 2 

C2 > -6X1 + X2 - 9X3 + 9 

1 29 5 

Cs > 2X1 - -^X2 + — X3 - - 

< xi < 3 
< X2 < 2 
< X3 < 2 

A>0, Ci>0; i = 1,2,3. 

Solving this problem using GAMS, we have an optimal solution at 
(xi,X2,X3,V'i,V'2,V'3,Ci,C2,C3) = (0.3913,0,0.7391,0,0,0,0,0,3.6413) and the optimal 
objective value is -1.2065. 



5 Conclusion and Further Research 

What we have done in this paper is that we use the concept of IVPMs to get the corre- 
sponding interval expected value of uncertain coefficients in an LP (or a QP with linear 
constraints) problem. Then our optimization problem becomes the same type as the 
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original problem with interval coefficients. By using functions u and v (given by a deci- 
sion maker), our problem is an ordinary problem which can be solved by any appropriate 
tools such as GAMS and LINDO. Moreover, it implied that IVPM (with independent 
uncertain random variables) can be used to put all three uncertainties, (probabilistic, 
possibilistic and interval), in one framework. So that optimization problems containing 
all three types of uncertainties in one problem, especially in one constraint inequality, 
(constraint in example l3. 11 for instance), can be solved. It needs an extra work before 
we can conclude that a similar statement holds (or not) if we add the other types of 
uncertainties to the problems. 

We restricted our uncertain random variables to be independent which makes it much 
easier when calculating the interval expected values. The question is that can we still be 
able to use the concept of IVPMs when we have dependent uncertain random variables. 
Therefore, the suggestion for further research is focusing on the dependence of uncertain 
coefficients. Also, we need to give a concrete semantics for our work. 
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